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Abstract 

We consider the problem of random uniform generation of traces (the 
elements of a free partially commutative monoid) in light of the uniform 
measure on the boundary at inhnity of the associated monoid. We obtain 
a product decomposition of the uniform measure at infinity if the trace 
monoid has several irreducible components—a case where other notions 
such as Parry measures, are not defined. Random generation algorithms 
are then examined. 

Keywords: trace monoid, uniform generation, Mobius polynomial 

1—Introduction 

Uniform generation of finite-size combinatorial objects consists in the design of 
a randomized algorithm that takes an integer k as input, and returns an object 
of size k, such that each object of size k has equal probability to be produced. 
This problem has been considered for many classes of objects from computer 
science or discrete mathematics: words, trees, graphs are examples. Several 
general approaches exist: recursive methods [ll|, the Markov chain Monte- 
Carlo method with coupling from the past [l^ , or the Boltzmann sampler 0- 
Other recent approaches share a common guideline, namely first considering 
a notion of uniform measure on infinite objects in order to gain, afterwards, 
information on the uniform distributions on finite objects. The theory of ran¬ 
dom planar graphs is an example of application of this idea. In this paper, we 
investigate the uniform generation of traces (elements of a trace monoid) and 
we base our approach on the notion of uniform measure on infinite traces. 

Given an independence pair (A, I), where I is an irreflexive and symmetric 
relation on the finite alphabet A, the associated trace monoid A4 = A4(A,I) 
contains all congruence classes of the free monoid A*, modulo equivalences of 
the form ab = ba for all (a, b) S /, see |^. Elements of A4 are called traces. 
Trace monoids are ubiquitous in Combinatorics, see [l^. They are also one of 
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the most basic models of concurrency under a partial order semantics [9|. Uni¬ 
form generation of traces is thus a fundamental question with possible applica¬ 
tions in probabilistic model checking of concurrent systems. Since our concern 
is with partial order semantics, it differs from the sequential approach which 
targets uniform generation of linear executions in models of concurrency Q . 

Consider a trace monoid A4, and, for each integer fc > 0, the finite set 


Mk = {x € M 


= k}. Let i^Mk t>e the uniform distribution over 


Mk- A crucial observation is that the probability measures (j^Atfe)fceN are not 
consistent. Consequently, the uniform measures vmu cannot be reached by a 
recursive sampling of the form xi ■... ■ Xk € Mk , with the Xi's being sampled 
independently and according to some common distribution over A. 

To overcome the difficulty, several steps are necessary. FirsL we consider the 


uniform measure at infinity for A4, a notion introduced in for irreducible 
trace monoids, and extended here to the general case. Second, we prove a 
realization result for the uniform measure at infinity by means of a Markov 
chain on a combinatorial sub-shift. Last, we apply the results to the uniform 
sampling of finite traces. None of the three steps is straightforward. Besides 
standard uniform sampling, it turns out that evaluating the uniform average 
cost or reward associated with traces can be done in an efficient way. 

An original feature of our approach is to define the measure at infinity 
for general trace monoids and not only for irreducible ones. We show that the 
uniform measure at infinity of a reducible trace monoid decomposes as a product 
of measures on irreducible components—contrasting with uniform distribution 
at finite horizon. In general, the uniform measure at infinity charges the infinite 
traces of the “largest” components of the monoid, and charges the finite traces 
of the “smallest” components. 

Another, different but related, notion of ‘uniform measure’ exists: the Parry 
measure which is a uniform measure on bi-infinite sequences of an irreducible 
sofic sub-shift [II, m. The construction can be applied to trace monoids, defin¬ 
ing a ‘uniform measure’ on bi-infinite traces, but only for irreducible trace 
monoids. Here we focus on single sided infinite traces instead of bi-infinite 
ones, and this approach allows to relax the irreducibility assumption, and to 
construct a uniform measure at infinity for a general trace monoid. In case the 
trace monoid is irreducible, we provide a precise comparison between the Parry 
measure, restricted to single sided infinite traces, and our uniform measure at 
infinity. The latter turns out to be a non-stationary version of the former. An¬ 
other important point is that our approach reveals the combinatorial structure 
hidden in the uniform measure at infinity (and in the Parry measure). 

The outline of the paper is the following. We first focus in a warm-up section 
(§ [2]) on the case of two commuting alphabets. Relaxing the commutativity 
assumption, we arrive to trace monoids in § [3) The purpose of § IH is twofold: 
first, to compare the uniform measure with the Parry measure; and second, to 
examine applications to the uniform sampling of finite traces. 


2—Warm-up: uniform measure for commuting alphabets 

Let A and B be two alphabets and let M be the product monoid M = A* x B*. 
The size of u = {x,y) in M is |u| = \x\ + |j/|. Let dA* = be the set of 
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infinite A-words, let A* = A* Li and similarly for dB* and B* . Define: 

57W = {(C,C) : 1^1+ 1(1 = 00 } , M=MUdM. 

Clearly one has DM = {A* x B*) — (A* x B*) and M = A* x B*. Both A* and 
B* are equipped with the natural prefix orderings, and M is equipped with 
the product ordering, denoted by <. For u G M., we put: 

u = {v G M : u < v} , u = G dM : u < ^} . 

Let po = 1/|A| and go = l/l^l • Without loss of generality, we assume that 
|A| > \B\, hence po < <?o • 

• Lemma 1 —For each real number p G (0,po]> there exists a unique probability 
measure Vp on A* such that i'p{ ft' cc) = holds for all x G A* . We have: 

Vp e (0,po) I'piA*) = 1, tjp„{dA*) = 1. 

The probability measures Vp in Lemma [T] are called sub-uniform measures 
of parameter p over A*. The measure Vp^ is the classical uniform measure on 
dA* which satisfies Vp„{f x) = p|f' for all x G A*. 

For each integer fc > 0, let denote the uniform distribution on A4k = 
{{x,y) G M : |(a:,p)| = k} . Since |A| > \B\, an element {x,y) G Mk sampled 
according to is more likely to satisfy |a:| > |y| than the opposite. In the 
limit, it is natural to expect that infinite elements on the B side are not charged 
at all, except if |A| = \B\. This is made precise in the following result. 

• Theorem 1 —Let ua and vb be the sub-uniform measures of parameter po = 
1/1 A| over A* and B* respectively. The sequence {vMk)k>o converges weakly 
to the product measure v = va® vb ■ 

We have: vif (x,y)) = for all {x,y) G M.; and v(dA* x B*) = 1 if 

|A| > \B\, whereas v{dA* x dB*) = 1 if |y4| = \B\. 

We say that the measure v described in Th. [T] is the uniform measure 
on dAi. We have the following “realization” result for i/. 

• Theorem 2 —Let {an)nefi be a sequence ofi.i.d. and uniform random variables 
(r.v.) over A. Letbo be a r.v. over B\J{\b*} , where 1 b* is the identity element 
of B*, and with the following law: 

WbGB F{bo = b)=po = l/\A\, ¥{bo = lB*) = l-Po/qo = l-\B\/\A\. 

Consider {bn)nen sampled independently in B A {1 b*} , each bn with the 
same law as bg, but only until it reaches 1 b* , after which bn is constant equal 
to 1 b* ■ Finally, set Uk G M. for all integers k > 0 by: 

Xk = ag- ...■ Qk-i G A* , yf. = bg- ...■ bk-l G B* , Uk = {xk,yk) G M . 

Then {uk)ken converges in law towards v. Furthermore, the random vari¬ 
able Vfe>o '^k G dM. is distributed according to v. 

Observe that 1b* will eventually appear in the sequence (6Ti)neN with prob¬ 
ability 1 if and only if po < qg. In this case, (pn)neN is eventually equal to a con¬ 
stant element of B* with probability 1. This is consistent with Theorem[T] Ob¬ 
serve also that (a„,5„)„gN forms a product Markov chain on ^ x (B U {Is*}). 

Both results stated in Ths. [T] and [5] are particular cases of corresponding 
results for trace monoids, as we will see next. 
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Figure 1: Two congruent words and the resulting heap (trace) 


3—Uniform and sub-uniform measures for trace monoids 

Basics on trace monoids. Let A be a finite alphabet equipped with an 
irreflexive and symmetric relation I C A x A, called an independence relation. 
The pair (A, I) is called an independence pair. Let I be the congruence relation 
on the free monoid A* generated by the collection of pairs {ab, ba) for (a, h) 
ranging over I. The trace monoid A4 = A4(A,I) is defined as the quotient 
monoid M = A* jX, see [^, UMlll- The elements of M are called traces. The 
identity element in the monoid is called the empty trace., denoted “Ijvi”, and 
the concatenation is denoted with the dot . 

The length of a trace u is well defined as the length of any of its representa¬ 
tive words and is denoted by |rt|. The left divisibility relation on Af is a partial 
order, denoted by “<” and defined by: u < v dry v = u ■ w . 

An intuitive representation of traces is given by Viennot’s heap of pieces in¬ 
terpretation of a trace monoid [l^. We illustrate in Fig.[T]the heap of pieces in¬ 
terpretation for the monoid M{A, I) with A = {a, b, c} and I = {{a, b), {b, a)}. 

The length of traces corresponds to the number of pieces in a heap. The 
relation u < v corresponds to u being seen at bottom as a sub-heap of heap v. 

The product monoid A* x B* from § [H is isomorphic to the trace monoid 
Ad(E, J), where E = A U B with A and B being considered as disioint, and 
I = {Ax B)li{B X A). 

Cliques and height of traces. Recall that a clique of a graph is a complete 
subgraph (by convention, the empty graph is a clique). We may view (A, I) as 
a graph. Given a clique c of (A, I), the product oi •... • Oj S At is independent 
of the enumeration (oi ,... ,aj) of the vertices composing c. We say that oi ■ 
... ■ Oj is a clique of Ad. Let denote the set of cliques, including the empty 
clique 1m ■ As heaps of pieces, cliques correspond to flat heaps, or horizontal 
layers. 

Traces are known to admit a canonical normal form, defined as follows 
Say that two non-empty cliques c, c' are Cartier-Foata admissible, denoted 
by c ^ c', whenever they satisfy: \/a G c' 3b € c {b, a) ^ I. For every 
non empty trace u S Ad, there exists a unique integer n > 0 and a unique 
sequence (ci,..., c„) of non-empty cliques such that: (1) u = ci • ... • c„; and 
(2) a —)■ Ci+i holds for all i S {!,...,n — 1}. The integer n is called the 
height of u, denoted by n = t{u). By convention, we put r(l^) = 0. The 
sequence (ci,..., c„) is called the Cartier-Foata normal form or decomposition 
of u. In the heap interpretation, the normal form corresponds to the sequence 
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of horizontal layers that compose a heap u, and the height t(u) corresponds to 
the number of horizontal layers. 

A useful device is the notion of topping of traces, defined as follows: for 
each integer n > 0, the n-topping is the mapping Kn '■ A4 —> A4 defined by 
i^n (u) = Cl Cn , where ci Cp is the Cartier-Foata decomposition 

of u, and where Ci = 1 m if i > P- 

Boundary. Elementary cylinders. Let £ = \ {Iat} denote the set 

of non-empty cliques. Traces of A4 are in bijection with finite paths of the 
automaton (£,—>■), where all states are both initial and final. Denote by dj\4 
the set of infinite paths in the automaton (£, ^■). We call dj\4 the boundary 
at infinity, or simply the boundary, of monoid A4, and we put M. — dM. 
Elements of dM are called infinite traces, and, by contrast, elements of M 
might be called finite traces. 

By construction, an infinite trace is given as an infinite sequence ^ = 
(ci,C 2 ,...) of non-empty cliques such that Ci —>■ c^+i holds for all integers 
z > 1. Note that the topping operations extend naturally to Kn ■ M ^ M, 
defined by Knif) = ci • ... • c„ , for ^ = (ci, C 2 ,...). _ 

We wish to extend the partial order relation < from M to M. For this, 
we first recall the following result [3, Cor. 4.2]: for u,v € M, if n = r(u), then 
u < V u < Kn{v). Henceforth, we put C, < f Vn > 0 «:rt(C) ^ 

Kn{C) for € M, consistently with the previous definition in case f,^GM. 
This order is coarser than the prefix ordering on sequences of cliques. 

For each u € M, we define two kinds of elementary cylinders of base u: 

fu = {^€dM : u < £,} C dM , '^u = {v&M : u<v}'^M. (1) 

The set M being countable, it is equipped with the discrete topology. The 
set A4 is a compactification of M, when equipped with the topology generated 
by the opens of M and all cylinders ft u, for u ranging over M . This makes 
M a metrisable compact space [i|. The set dM is a closed subset of M. The 
induced topology on dM is generated by the family of cylinders t '*^7 for zz 
ranging over M. Finally, both spaces are equipped with their respective Borel 
cr-algebras, 1? on A4 and 3^ on A4; the cr-algebra on each space is generated by 
the corresponding family of cylinders. 

Mdbius polynomial. Principal root. Sub-uniform measures. We re¬ 
call [13 definitions of the Mdbius polynomial plm{X) and of the growth 
series G{X) associated to M: 

, G{X) = Y, = 5] XmHX- , (2) 

cG^ ueM n>0 

where XM{n) = #{a: € M : |a;| = n}. It is known that G{X) is rational, 
inverse of the Mobius polynomial: 

G(X) = 1/fiMiX) . 

It is also known 00 that p,m{X) has a unique root of smallest modulus, 
say po , which lies in the real interval (0,1) if |A| > 1 (the case |A| = 1 is 
trivial). The root po will be called the principal root of fiM ; or simply of M. 
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The following result, to be compared with Lemma [U adapts the so-called 
Patterson-Sullivan construction from geometric group theory. The compactness 
of A4 is an essential ingredient of the proof for the case p = po , based on 
classical results from Functional Analysis. 

• Theorem 3 —For each p G (0,po]; where po is the principal root of A4, there 
exists a unique probability measure Vp on (Ad,®") such that x) = holds 
for all X G Ad. On the one hand, if p < po , then Vp is concentrated on Ad, and 
is given by: 

Vx G Ad r'p({x}) ■ (3) 

On the other hand, Up^ is concentrated on the boundary, hence i'pg(dAi) = 
1. In this case, Vpo{f x) = holds for all x G M. 

• Definition 1— The measures Vp on Ad described in Th. [3] are called sub¬ 
uniform measures of parameter p. The measure Vp^ is called the uniform mea¬ 
sure on dM. 

The following result relates the uniform measure on the boundary with the 
sequence of uniform distributions over the sets Adfc = {x G Ad : |x| = k}. 

• Theorem 4 —Let M be a trace monoid, of principal root po . The sequence of 
uniform distributions {i'Mk)k>o converges weakly toward the uniform measure 
Vp„ on dM.. 

Anticipating on Th. [3] below, Theorem U] above has the following concrete 
consequence. Fix an integer j > 1, and draw traces of length k uniformly at 
random, with k arbitrarily large. Then the j first cliques of the trace obtained 
approximately behave as if they were a Markov chain {Ci,... ,Cj); and the 
larger k, the better the approximation. Conversely, how this can be exploited 
for random generation purposes, is the topic of Sect. 0] 

Irreducibility and irreducible components. Generators of a trace monoid 
only have partial commutativity properties. The following definition isolates 
the parts of the alphabet that enjoy full commutativity. 

• Definition 2— Let {A, I) be an independence pair. The associated dependence 
pair is {A, D) where D = {A x A) \ I. The connected components of the 
graph {A, D) are called the irreducible components of M = M{A,I). To 
each of these irreducible component A' is associated the independence relation 
I' = In {A' X A'). The corresponding trace monoids M' = Ad (A', I') are called 
the irreducible components of the trace monoid Ad. If {A, D) is connected, then 
Ad is said to be irreducible. 

Direct products of trace monoids are trace monoids themselves. More pre¬ 
cisely, the following result holds. 

• Proposition 1 —Let Ad = M(A,I) be a trace monoid. Then Ad is the direct 
product of its irreducible components. As a measurable space and as a topolog¬ 
ical space. Ad is the product of the Ad', where Ad' ranges over the irreducible 
components of Ad. The Mobius polynomial p.m{X) is the product of the Mobius 
polynomials pM’iX), for Ad' ranging over the irreducible components of Ad. 
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The sets M.k = {x G M : |a;| = fc} do not enjoy a product decomposition 
with respect to irreducible components of A4, hence neither do the uniform 
distributions over A4k ■ By contrast, sub-uniform measures have a product 
decomposition, as stated below. 

• Proposition 2 —Let A4 be a traee monoid, of principal root po , and let Vp be 
a sub-uniform measure on A4 with p < po ■ Then Vp is the product of measures 
v' on eaeh of the M.', for M' ranging over the irreducible components of M. 
The measures v' are all sub-uniform measures on A4' of the same parameter p . 

It follows from Prop. [T] that the principal root of a trace monoid M is the 
smallest among the principal roots of its irreducible components. As a conse¬ 
quence of Prop, m the uniform measure is a product of sub-uniform measures 
v' over the irreducible components Ai' of A4. By Th. [31 each n' is either con¬ 
centrated on M' if the principal root p' of Ai' satisfies p' > po , or concentrated 
on dA4' if p' = po . Note that at least one of these sub-uniform measures is 
actually uniform on the irreducible component. 

Realization of uniform and sub-uniform measures. The characteriza¬ 
tion of the uniform measure by I'if x) = (see Th. [3]) does not provide an 
obvious recursive procedure for an algorithmic approximation of z^-generated 
samples on dA4. Since the uniform measure n is, according to Prop. [31 a prod¬ 
uct of sub-uniform measures, it is enough to focus on the algorithmic sampling 
of sub-uniform measures on irreducible trace monoids. 

Hence, let A4 be an irreducible trace monoid, of principal root po , and let 
Ai be equipped with a sub-uniform measure z/p with p < po ■ Recall from Th.|3] 
that z/p is either concentrated on A4 or on dA4 according to whether p < po or 
P = Po- 

Elements of A4 are given as finite paths in the graph (£, —>■), whereas ele¬ 
ments of dA4 are given as infinite paths in (£, —>■). In order to have a unified 
presentation of both spaces, we use the following technical trick: instead of 
considering the graph of non empty cliques (£,—>■), we use the graph of all 
cliques ('^, —>■), including the empty clique. We keep the same definition of the 
Cartier-Foata relation (see above). Note that c —>■ 1m then holds for every 
clique c G whereas 1m ^ c holds if and only if c = 1m- Hence l^vi is an 
absorbing state in ('^, —>■). Any path in (£, ^), either hnite or infinite, now 
corresponds to a unique infinite path in {If, —>■). If the original path {ck)i<k<N 
is finite, the corresponding infinite path (cj,)fe>i in ('^, —>■) is defined by cj. = Ck 
for 1 < fc < A^ and cj, = 1m for all k > N. 

For each trace ^ G A4, either finite or infinite, let {Ck)k>i be the infinite 
sequence of cliques corresponding to the infinite path in (f^, -^) associated 
with f. The sequence {Ck)k>i is a random sequence of cliques; its characteri¬ 
zation under a sub-uniform measure Vp is the topic of next result. 

• Theorem 5 —Let Ad he an irreducible trace monoid of principal rootpQ . Then, 
with respect to the sub-uniform measure Vp on Ai, with 0 < p < po, the se¬ 
quence of random cliques {Ck)k>i is a Markov chain with state space 

Let g,h : ^ ^ be the functions defined by: 

h{c)= Y. (-1)''=''-''='^'^'', 5(c) = . (4) 

■ c''>c 
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Then {h{c))^^^ is a probability vector over which is the distribution of 
the initial elique Ci . This vector is positive on £, and > 0 if and only 

if p < po . The transition matrix of the chain, say P = {Pc,c'){c,c')£<^x‘^ > is: 

{ 0, if c ^ c' does not hold, 

h{c')/g{c), if c^c' holds, 

with the line {Pim,c’)c’£^ eorresponding to the empty clique undefined if p = 
Po ■ 

Conversely, if p < po , and if {Ck)k>i is a Markov chain on if p < po, 
respectively on €. if p = Po, with initial distribution h defined in o and with 
transition matrix P defined in and if Yk = Cl Ck , then {Yk)k>i 

converges weakly towards the sub-uniform measure Vp . Furthermore, the law 
of the random trace Ci ■ C 2 ■ ■ ■ ■ = Vfe>i Yk G A4 is the probability measure Vp 
on A4. 

TheoremOfor p = po already appears in 0. Note: the function h ^ 
defined in (|3]) is the Mobius transform in the sense of Rota [Si of the function 
/ : c e ; see i for more emphasis on this point of view. 

As expected, we recover the results of § [2] in the case of two commuting 
alphabets A and B with \A\ > \B\. Indeed, by Prop. [Hand Th. 0 the cliques 
{Ck)k>i form a product of two Markov chains: one on A {non empty cliques 
of A*) and the other one on i? U {Is*} {cliques of B*, including the empty 
one). 


4—Uniform Generation of Finite Traces 

We have introduced in Def. [T] a notion of uniform measure on the boundary 
of a trace monoid. This measure is characterized by its values on cylinders in 
Th. [21 as the weak limit of uniform distributions in Prop. |21 and through the 
associated Cartier-Foata probabilistic process in Th. O 

Because of the existence of the Cartier-Foata normal form of traces, the 
combinatorics of a trace monoid is entirely contained in the Cartier-Foata au¬ 
tomaton, either (‘^, —>■) or (£, —>■). Looking at the Cartier-Foata automaton, say 
(£, —>■) on non empty-cliques, as generating a sub-shift of finite type, it is inter- 
esting to investigate the associated notion of uniform measure ‘a la Parry’ [H, 
[l3|,[l5| , and to compare it with the uniform measure on the boundary previously 
introduced. This comparison between the two notions of uniform measures will 
enlighten the forthcoming discussion on uniform generation of finite traces. 

Uniform measure on the boundary versus Parry measure. The Parry 
measure associated with an irreducible sub-shift of finite type is formally defined 
as the unique measure of maximal entropy on bi-infinite admissible sequences 
of states of the sub-shift. It corresponds intuitively to the “uniform measure” 
on such bi-infinite paths (see, e.g., 0). 

The Parry measure is only defined for irreducible sub-shifts for good reasons. 
Indeed, if a sub-shift has, say, two parts X and Y, with Y an irreducible 
component and such that going from X to T is possible but not the other 
way around as in Fig. |ll-(a), then one cannot define a “uniform measure” on 
bi-infinite paths (it should put mass on paths spending an infinite amount of 



Figure 2: (a) Illustration of a reducible system (b) Cartier-Foata automaton 
on non-empty cliques of A* x B* generating the uniform measure on d{A* xB*) 
if |A| > \B\ 


time both in X and Y and be stationary, which is impossible). On the other 
hand, considering a uniform measure on one-sided infinite sequences on such 
a compound system makes perfect sense. This is the case, for instance, of the 
Cartier-Foata sub-shift associated to the reducible trace monoids A* x B* with 
|A| > \B\ studied in §[^ see Fig. [21-(6). 

For a general trace monoid A4, the associated sub-shift (£, is irreducible 
if and only if the monoid A4 is irreducible in the sense of Def. [2] (a well-known 
result: see for instance 1% Lemma 3.2]). Therefore the comparison between 
the uniform measure on the boundary, and the Parry measure, only makes 
sense in this case. 

Hence, let M be an irreducible trace monoid, of principal root po . In 
order to take into account the length of cliques in the construction of the 
Parry measure, we consider the weighted incidence matrix B = {Bx,y)(x,y)eex€ 
\v\ 

defined by Bx,y = Pq A x ^ y holds and by Bx,y = 0 if a; —>■ y does not hold. 


• Lemma 2 —The non-negative matrix B has spectral radius 1. The vector g = 
ig{c))ce£ defined by g{c) = X^c'ec • c->c'^(*^0 c S £, where h has been 
defined in m, is B-invariant on the right: Bg = g. 

Define the matrix C = {Cc,c'){c,c')e£xc by: 


Vc, c' G £ Cc,c' = Bey g{c')/g{c). 


( 6 ) 


Since g is right invariant for B, it follows that C is stochastic. Classically, 
the Parry measure on bi-infinite paths in (£, —>■) is the stationary Markovian 
measure of transition matrix C. 

• Proposition 3 —The matrix C defined in ([HI) coincides with the transition ma¬ 
trix P defined in Theorem^ for p = po ; find restricted to €x 

Proposition[2] asserts that the Markov chain associated with the Parry mea¬ 
sure has the same transition matrix as the probabilistic process on non-empty 
cliques generated by the uniform measure on the boundary. But the Parry 
measure is stationary whereas the uniform measure v is not. Indeed, the initial 
distribution of the Markov measure n is h : ^ A?, which does not coincide 

with the stationary measure of the chain (except in the trivial case of a free 
monoid). 

To summarize: the notion of uniform measure on the boundary is adapted to 
one-sided infinite heaps, independently of the irreducibility of the trace monoid 
under consideration. If the monoid is irreducible, there is a notion of uniform 
measure on two-sided infinite heaps, which correspond to a weighted Parry 
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measure. Considering the projection of this Parry measure to one-sided infinite 
heaps, and conditionally on a given initial clique, it coincides with the uniform 
measure at infinity since they share the same transition matrix. But the two 
measures globally differ since their initial measures differ. 

Uniform generation of finite traces, 0. The Parry measure is a standard 
tool for a special type of uniform generation. Indeed, it provides an algorithmic 
way of sampling finite sequences of a fixed length fc, and uniformly if the first 
and the last letters of the sequence are given. In our framework, besides the 
fact that the Parry measure is only defined for an irreducible trace monoid, it 
also misses the primary target of generating finite traces of a given length k 
among all traces of length k. 

Uniform generation of finite traces, 1. Consider the problem, given a 
fixed integer fc > 1 and a trace monoid M. = M{A, I), of designing a random¬ 
ized algorithm which produces a trace a; € Af of length k, uniformly among 
traces of length k. Sub-uniform measures on the trace monoid M allow to 
adapt to our framework the technique of Boltzmann samplers jlflj l for solving 
this problem. 

Consider a parameter p € (0,po), where po is the principal root of A4, and 
let ^ S Af be sampled according to the sub-uniform measure Vp. We have 
indeed |^| < oo with probability 1 by Th.[2] Furthermore, Prop. [5] shows that 
t'p decomposes as a product of sub-uniform measures of the same parameter p, 
over the irreducible components of Ad. For each component, sampling is done 
through usual Markov chain generation techniques since both the initial mea¬ 
sure and the transition matrix of the chain of cliques are explicitly known by 
Th. O 

The algorithm is then the following: if |^| = k, then keep otherwise, 
reject ^ and sample another trace. This eventually produces a random trace of 
length k, uniformly distributed in A4k ; since Vp is a weighted sum of all VMk > 
as shown by the expression f5|l. 

As usual, the optimal parameter p, for which the rejection probability is 
the lowest, is such that: = fc, where denotes the expectation 

with respect to Vp. Ordinary computations show that is related to the 

derivative of the growth function by |^| = pG'{p)/G{p) = —pp'j^ (p)/P m (p) ; 
providing an explicit equation 

kpMip) ApPm^p) = 0 , 

to be numerically solved in p. 

Unfortunately, the rejection probability approaches 1 exponentially fast as 
k increases, making the algorithm less and less efficient. A standard way to 
overcome this difficulty would be to consider approximate sampling [l^, con¬ 
sisting in sampling traces of length approximately k. 

Uniform generation of finite traces, 2: evaluating an average cost. 

Uniform generation is often done in order to evaluate the expected value of a 
cost function. For this purpose, a more direct approach in our framework is 
based on an exact integration formula given in Th. [5] below. 
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Let (/) : Atfe —^ be a cost function, and consider the problem of evaluating 
the expectation {(t^) i for a fixed integer k. For each integer k > 0, let: 

Mk = {xeM : \x\ = k} , XM{k) = #Mk, M(k) = {x € M : t{x) = k} . 

To each function (j> : A4k ^ ^ defined on traces of length k, we associate a 
function (p : Ai{k) —>■ defined on traces of height k, as follows: 

Vx G 7W(fc) p{x) = (piy). (7) 

y&Mk ■■ y<x 


• Theorem 6 — Let p : Ai(^k) he defined as in ([ 7 ]). Then the following 

equality holds between the expectation with respect to the uniform distribution 
VMk -^fc on the one hand, and the expectation with respect to the uniform 
measure v on dAi on the other hand (whether A4 is irreducible or not): 

E-at, 0 = (p§ • (fc)) ■-..-Ck). (8) 

The generation of {Ck)k>i enables us to evaluate Ei,(/)(C'i • ... • Ck) for any 
integer k, provided the function (p can be efficiently computed. In turn, this 
directly depends on the numbers 0fc(x) = (f{y G A4k '■ y < x} of terms in 
the sum © defining <p{x). The numbers 0k{x) might be arbitrary large; for 
instance 9k{{a ■ b)^) = fc + 1 for (a,6) G I. However we have the following 
result. 

• Lemma 3— Assume that A4 is irreducible. Then, there exists C > 0 such that: 


E,0fe(Ci ■...■Ck)<C. 


To see this, apply ([HI) to the constant function ^ = 1 on , whose asso¬ 
ciated function is p = 0k on A4(k) , to obtain: 


E,,0kiCi ■ ... ■ Ck) = p’( ■ XMik). 


(9) 


The terms XM^k), coefficients of the growth series C{X) = , are 


asymptotically equivalent to Cp^ ^ for some constants C > 0 if Ad is irre¬ 
ducible 1^. The result in Lemma [3] follows. 


Applying usual techniques Q to specifically retrieve all traces y < x of 
length k = r(x) is feasible in time 0{k) in average and allows to compute p{x), 
and consequently to estimate the expectation E,jp{Ci ■ ■ Ck) via Markov 

chain sampling and a Monte-Carlo algorithm. 

By Q, applying the same estimation technique to the function p = 1 yields 
an estimate for the normalization factor Pq ■ Xm {k). In passing, this also yields 
a Monte-Carlo estimate for the number A^(A:). All together, we are thus able 
to estimate with an arbitrary precision both terms in the right hand member 
of ((5|), hence yielding an accurate estimation ofE,yj^^p. 

To summarize: generating the first k layers of traces under the uniform 
measure on the boundary allows to compute the expectation of an arbitrary 
computable cost function p : Mk —>■ R, if Ad is irreducible. The same applies 
at the cost of a greater complexity if Ad is not irreducible. 
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Appendix: proofs 


Proof of Theorem [Sj We first recall that two traces x,y € Ai having a 
common upper bound have a least upper bound xW y, in which case x and y 
are said to be compatible. Therefore: 


fr a;n tr y = 


0 , 

tr (x V y), 


if X, y are not compatible, 
if X, y are compatible. 


It follows that the collection of elementary cylinders fl x, to which is added 
the empty set, is stable by finite intersections. They form thus a 7r-system. It 
follows that a measure v on (Ad,5^) is entirely determined by its values on all 
elementary cylinders "fl x, for x & M.. The uniqueness stated in the theorem 
follows. 

We also recall that, since the growth series G{X) has positive coefficients 
on the one hand, and since the formal equality G{X) = 1/plm{X) holds on the 
other hand, the radius of convergence of the power series G{z) is exactly po ■ 
Let Vp be the probability measure on M. defined, for p £ [0,po)) by: 


where 5y denotes the Dirac measure concentrated on {y}. The measure Vp is 
well defined for 0 < p < po since G{p) < +oo, as recalled above. 

We prove that Vpit x) = p^^^ for all x £ A4. Observe that the mapping 
y&M^x-y is a. bijection onto fl x 0 Ad. Since Up is concentrated on Ad, 
we compute for any x £ Ad: 


r'p(fr x) 


r'p(fl'xnAd) 


E 


G{P) 

1 




yGA4:y^x 


G{P) 
P 


Ep 


\x-v\ 


yGM 

\-\J_ y p 

y^M 


\v\ 


G[p) 


P 


\x\ 


This shows that Vp{ fl x) = holds for all x £ Ad. 

For p = pq, we adapt the construction of the so-called Patterson-Sullivan 
measure. Consider any weak limit, say z/pg , of by letting p —>■ po ■ Such 
a limit exists since Ad is compact and therefore any sequence of probabilities 
on Ad has a weakly convergent subsequence. In Ad, any cylinder fl x is both 
open and closed, therefore its topological boundary is empty, and therefore has 
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null t'pp-measure. By the Porte-manteau theorem (see for instance Billingsley’s 
Convergence of prohahility measures), we have thus: 


Vpoit x) = lim lypifx) = lim = pIT'■ (10 ) 

p-^po P^PO 

For the same reasons, we have for every x G A4: 

’^Po{{x}) =pi™yp({4) 


p->po G{p) 

= 0 , 

since G{po) = -l-oo. Since M is countable, it follows that Vpg{M) = 0, and 
thus Vpg is concentrated on the boundary. Finally, since t =lt a; fl dM, and 
using that Vpg[M.) = 0, we obtain: 

^'po(t a:) = Vp„{-<f xCdM) = Vp^{^ x) = ' . 

This completes the proof of Theorem [31 


Proof of Theorem Since fA is compact, to show that {vMk)k converges 
toward Vp^ , it suffices to show that Vp^ is the weak limit of any weakly conver¬ 
gent subsequence of {vMk)k ■ Let v be the weak limit of a weakly convergent 
subsequence ■ Using the estimate ~fc-).oo Ck^p^^ (see [l^) , we 

have for all a: G Af and for all j large enough: 


^MkA1tx)= ff{yeM : \y\=kjAy>x} 


AM 


kn 


-A{y eM : |y| = kj - |a;|} 


1 


-kj 1 ^ 1 ) Po 

C{kj)^Po 

1^1 
Po ■ 


N \x\-kj 


Using the Porte-manteau theorem as in the proof of Th. [31 we have thus: 
v{1lx)= lim VMk ■i1lx)= p[r' , 

j—yoo ^ 


and therefore v = Vp^ , using as above that measures are entirely determined 
by their values on elementary cylinders. This shows that {vMk)k converges 
toward Vp^ . The proof of Theorem [3] is complete. 


Proof of Proposition |T1 For simplicity, assume that M. has exactly two 
irreducible components Mi and M 2 , and let Ai and A 2 be the corresponding 
irreducible components of A. 

Let *1 : Ml —)■ M and Z 2 : M 2 —t At be the natural injections, and let 
/ : All X AI 2 —^Mhe defined by f{xi,X 2 ) = ii{xi) ■ 12 ( 2 : 2 ) = 12 ( 2 : 2 ) • *i(a:i). 
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Then it is clear that / is an isomorphism. The natural morphism tti : M ^ A4i 
for instance, is entirely determined by: 


Va: S Ai U A 2 7ri(a;) 


0 , if X € A 2 , 

X, if X € Ai . 


We extend / to x A42 —t as follows. Let us first identify A4i and 
A42 with sub-monoids of A4, through the natural injections ii and 12 . The 
two following properties are obvious: 


(a) Vxi G All Vx 2 G A42 xi ■ X 2 = X 2 ■ xi 


(b) \/u,v,w € M u>v => w-u>w-v 

Now let {x,y) G Ali x AI 2 ■ Let (c„)„>i and {dn)n>i be the Cartier-Foata 
sequence of cliques of Afi and of Al 2 associated to x and y respectively. It is 
not difficult to see that, by putting = ci • ... • c„ and ?/„ = di • ... • (i„ , one 
has: 


\J Xn = X in All, \J yn = y ix^ M 2 ■ 

n>l n>l 


Then observe that the sequence {xn'yn)n>i is non decreasing in At. Indeed: 


Xn-\-l ■ yn-\-l ^ Xn-\-l * y-n 

— yn ' Xn~\-1 
^ yn ' Xn 
— Xn * y-n 


by® and since yn+i > J/n 
by (jg) 

by® and since a;„+i > Xn 
by (ja} . 


Since AI is complete w.r.t. the least upper bound of non decreasing se¬ 
quences (see [3, § 2.1]), we define f{x,y) G M by: 

f{x,y)=\/{xn-yn) inM. 

n>l 


It is then routine to see that / thus defined is a bijection Ali x AI 2 M . 
Using the natural morphisms tti : Ad —AIi and 7r2 : AI —t AI 2 , we have: 

yxeM /-^(fra:) = fr ( 7 ri(a:))x fr (712(0:)) , 

V(a:i,a; 2 ) G Adi x Ad 2 /(fl xix ff 0 : 2 ) = tf {xi ■ X 2 ) ■ 

This shows that / is a homeomorphism, hence a fortiori bi-measurable. 

Finally, let denote the set of cliques of Al, and let '^ 1 , “^2 denote the sets 
of cliques of Adi and Ad 2 respectively. The isomorphism f : Mi x M 2 ^ M 
induces by restriction a bijection '^1 x "^2 —t from which follows the product 
decomposition = fiMi MM 2 ■ The proof of Proposition [T] is complete. 


Proof of Proposition!^ Assume for simplicity that Ad has two irreducible 
components, say Ali and Ad 2 ■ For x G Al, let xi = 7ri(x) G Adi and X 2 = 
7T2(x) G Ad 2 be the components of x in Adi and in Ad 2 . Then we have: 

t^pitx) = v'p{f[xi) X r'"(tra;2). 
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where ly'p is the sub-uniform measure of parameter p on , and v'^ is the sub¬ 
uniform measure of parameter p on Mi. Using again that the collection of 
elementary cylinders is a 7r-system, this is enough to conclude that Vp = v'p®Vp . 
The proof of Proposition is complete. 

Proof of Theorem!^ Our proof extends the proofs of [3, Th. 2.4, Th. 2.5] 
by taking into account the possible presence of the empty clique in the Cartier- 
Foata decomposition of traces. It also makes a specific use of the existence of 
the uniform measure obtained through the construction of Theorem [31 Let p 
be a real number such that p < po . 

For two cliques c, c' G ^ let us write c || c' whenever cx c' C which is 
equivalent to saying both c D c' = 0 and c- c' 

Let us denote by Ci,..., Cfe the first k cliques in the Cartier-Foata decom¬ 
position of a random trace ^ G Ai. Let ci —^ Cfc be a Cartier-Foata 
sequence of cliques, Ci G ^ for all i G {1,... ,k}, and put x = ci ■ • Ck-i . 

Then we have: 

G M : Cl = Cl,... ,Ck = Ck} =i[ {x ■ Ck)\ y 'fl(a;-c) (H) 

: c>Cfc 

Let (oi,..., Or) be an enumeration of the elements a of the alphabet A such 
that a ^ Ck and Ck U {a} G , or equivalently with the above notation, those 
a G A such that a jj c. Then m rewrites as: 

r 

{^GM : Cl = Cl,... jCfc = Cfc} ='f|'(a: • Cfe) \ IJ [x ■ Ck ■ a^) 

i=i 

Passing to the probabilities on both sides yields: 

r 

iyp{Ci = Cl,... ,Ck = Ck) = Vp{it (x ■ Ck)) - Vp([J il {x ■ Ck ■ ttj)^ , (12) 

i=i 

R 

since the union on the right side member is included in ff- (a: • c^). We evaluate 
the term R in (1121) using Poincare inclusion-exclusion principle: 

r 

R = '^{-1)^+^ ^ (a: • c/c • azj n .. .n tl (a: • Cfc ■ aq)) 

j=l l<li<---<lj <r 

r 

= Vp{^ {x ■ Ck ■ c')) 

3 = 1 c'eC : cj,||c'A|c'|=j 

= 51 {-^)^‘''^^^Vp{{'^i.x-Ck-c')) 

c'ec : Cfcllc' 

= ^ (—(a: ■ (5)) with the change of variable J = c/c • c' 

iSe'^ : <5>Cfc 

Returning to m, we get: 

l/p(Ci = Ci,...,Cfc=Cfc)=pl"l + l=^l+ ^ (_l)l^|-kdpl-l + |5| 

<5e*’ : S>Ck 

= 51 (-1)''^'“'^'“'/) ■ 

■ <5>Cfc 
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From this we deduce the following formula: 

r/p(C'i = Cl,... ,C'fe = Cfe) = , with X = Cl • ... • Cfe_i, (13) 

if Cl Cfe holds, and where h ^ ^ is defined by ([3]). In particular 

for A: = 1, we get: 


Vci S 'lo Vp{C\ = Cl) = h{ci ), 

which proves at once that is a probability vector, and that it is the 

distribution of the first clique Ci under i/p . 

Let us prove that h is non zero on £. Since M is irreducible, the graph 
(£, -^) of non empty cliques is strongly connected (a well known result, see a 
proof in H)- Let c G £, and let c' G £ be maximal in {'if, <). Let ci,..., c„ 
be n > 2 non empty cliques such that ci c„ holds, and ci = c and 

Cn = c'. Then, by (fl^ , we have: 

Vp(Ci =ci,...,C'„ =Cn) = 

= p|ci| + ... + |c„_i|p|c„| ^ 

since h{cn) = by the maximality of c„ . In particular: 

^p{C\ — Cl) ^ Vp{C\ — Cl, . . . , Cn — Cyj) ^ 0 . 

But we also have VpiCi = ci) = /i(ci), and thus h{ci) ^ 0, which was to be 
shown. The value h{lM) coincides with h{lM) = MAr(p)- Since po is the root 
of smallest modulus of pM , and since p < po , H follows that h{lM) = 0 if and 
only if p = Po • 

We now come to the proof that {Ck)k>i is a Markov chain, and to the 
cormiutation of its transition matrix P. If p = po, then this is the result 
of [2, Th. 2.5]. The identity of the transition matrices given in the present 
statement on the one hand, and in [2, Th. 2.5] on the other hand, follows 
from [3, Prop. 4.12]. Hence, assume that p < po . 

If Cl Cfe holds, with all Cj ^ 0, then the expression (IT^ combined 

with the fact that h 7 ^ 0 on £, implies that Vp{Ci = ci,..., Ck-i = Ck-i) 7 ^ 0 . 
Henceforth the following conditional probability is well defined: 

\ci\ + ... + \ck-i\u(„ \ 

.p(C, = «|C, = c,.C,_, = «_,) = (14) 

pl^'°-il/t(Cfc) 

h(ck-i) ^ ^ 

In case one of the cj is the empty clique, then the cliques C 7 + 1 ,..., Cfc must 
also be empty since we assume that ci Cfc holds, and thus: 

Vp{Ck = Im\Ci = Cl,..., Cfc_i = Cfe_i) = 1 if one Cj with j < k is 1 m- 

(16) 

Since Ck-i = Ck = 1 m, the right member of ca evaluates to 1 as well in this 
case. Hence (USD is valid in all cases if Ci Cfe holds. Since the right 
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member of m only depends on Ck-i,Ck on the one hand, and since on the 
other hand it is clear that we have: 

^p{Ci = Cl,... ,Ck = Cfc) = 0 , if Cl Cfc does not hold, 

we conclude that {Ck)k>i is indeed a Markov chain with the transition matrix 
described in the statement of the theorem. 

For the proof of the converse part of the statement, we proceed in four 
steps. Consider the two following claims: 

1. The vector {h{c ))is a probability vector. 

2. The matrix P is stochastic. 

Since we already know the existence of the measure Vp by Theorem [31 the 
results already shown so far in the proof make both points (THU immediate. 
They follow from the mere existence of the Markov chain {Ck)k>i previously 
defined under the measure Vp on M, since h is the distribution of Ci and P is 
the transition matrix of the chain. 

For the next claim, we introduce new notations in order to avoid confusion 
with the Markov chain {Ck)k>i previously defined. 

3. Let {C'j.)k>i be a Markov chain on with initial distribution h and 
transition matrix P, and let = C[ -.. .-C^ . Then the law of \/fc>i ^k ^ 
M is I'p. 

Let (n, 0,P) be the sample space on which the Markov chain (C^)fe>i is 
defined, and put = Vfe>i ^k the proof of Prop.[T]above for the existence 
of the least upper bound in Ad). Let also ^ G be the canonical random vari¬ 
able defined on Ad with law i^p . Then we have, for every sequence (ci,..., Ck) 
of cliques: 


f>{C[ = Cl,..., Cfc = Cfc) = Vp{Ci = Cl,..., Cfc = Cfc), 

since (Cfc)fe>i and {C'j.)k>i have same initial distribution and same transition 
matrix. Therefore, for every x G A4 and for k = t{x), we have: 

IP(^' >X)= P(Kfc(C') >X)= Vp{Kk{0 > x) = Vpii >x) = i^pit x). 

This proves that i^p is indeed the law of , and completes the proof of 
Point [3] 

Finally, it remains only to show the following point: 

4. The sequence (PfcOfc>i converges toward Up in distribution. 

With the same notations as above, we have for every x G M and for every 
integer k > t(x): 

'^iXk ^ x) = f‘(^ Yj > x^ = P(^' >x) = Vp{ •ft' a;), by Point|31 
a>i 
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Hence for every x € Ai, the value of ^{Yl > x) is eventually constant 
when k —>■ oo, equal to x). This implies the convergence of iXk)k>i in 
distribution toward the distribution Vp . 

The proof of Theorem [5] is complete. 


Proof of Lemma We first show that g is H-invariant on the right. For 
p = Po : it follows from [1, Prop. 4.12] that the formula h{c) = Po‘^'p(c) holds 
for all cliques c S £. Therefore, for all c G £, we have: 

{Bg)c = ^ Pc'" 'ff(c') = ^ h{c') = g{c). 

: c—^c' c ': c—¥c' 


We now prove that B has spectral radius 1. Let ||M|| denote the spectral 
radius of a non-negative matrix, that is to say, the largest modulus of its 
eigenvalues. For p < po, let Bp be the matrix of size |£| and defined by 


iBp){c,c') 


0 , if - 1(0 —>■ c') 
pl'^ I, if c —>■ c'. 


Hence: B = Bp^ . Let us show that: 

Vp<Po ||i?p||<l. (17) 

Then by upper semi-continuity of the spectral radius, letting p —>■ po , we will 
deduce ||H|| < 1. And since we already proved that B has a right-invariant 
vector, we will obtain the equality ||i?|| = 1. 

To prove CZD, it is enough to show the following: 

VAg(0,1) < 00 , (18) 

fc >0 

where I and F are the positive vectors of dimension |€| defined as follows: 

Vc G £ Ic = 1, Vc G £ Fc = Apl°l, 

and /' is the transpose of /. Indeed, (1181) implies that A“^ Id—Hp is invertible 
for all A G (0,1), and thus, since Bp is non-negative, that its largest eigenvalue 
cannot be greater than 1. 

Fix A G (0,1). Then: 

Vfc>0 I\\BpfF= A'^pl^l, 

: T{u)—k 


and thus: 

/'(^(AHp)'=)F = ^A%(fc), (19) 

fc >0 fc >0 

with Rp{k) = ■ 

uGA4 : t ( u)=/c 
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But, for p < po, we have: 


Rp{k) = Y = ‘^(p) < °° ■ 

k>0 uGA4 

Therefore limfc_>cx 3 Rp{k) = 0. By (fTOl) . it follows that (fT51) holds, which was to 
be shown. The proof of Lemma [5] is complete. 

Proof of Proposition [Sj Clearly, Cc,c' = 0 = Pc,c' if c —?■ c' does not hold. 
For c, c' S £ such that c ^ c' holds, we have: 

C'c.c' = Po '5(c')/5(c) = h{c')/g{c ), (20) 

by the formula h{-) = PQ^g{-) recalled above in the proof of Lemma[^ Still for 
p = Po , we have, according to formula (O of Theorem [5J 

Pc,c' = h{c')p^Q^/h{c) = h{c')/g{c) since h{c) = Po^g{c). (21) 

Comparing (1^ and (pH) . we obtain that P = C on x . To get that C is 
stochastic, it remains only to show that Pc,1m — 0 cliques c S £. And 

indeed, by formula ®, we have: 

w p. p _ P^o'^KIm) _ p|)"'/^A^(Po) _ „ 

^(c) g{c) 

The proof of Proposition [3] is complete. 

Proof of Theorem [6l Let V denote the uniform measure on the boundary. 
We compute the expectation of (()(C'i ■ ... ■ Ck) under v as follows: 

E,.^(Ci • ... • Cfc) = ^ ix{Ci- ...■Ck=x)( Y 

: T{x) = k ^ y^JA : y<x/\\y\—k '' 

= Y '^(2/)f Y ■ ...■Ck = x^ 

y^JA : \y\—k xGA 4 : T(x)=kAx>y 

= Y 

yeM : \y\=k 

= Po ■ {#Mk) ■ (j) since v) = ' = Po 

This completes the proof of Theorem [S] 
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